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Abstract 

Given N real numbers whose sum is an integer, we study the prob¬ 
lem of finding N integers which match these real numbers as closely as 
possible, in the sense of norm, while preserving the sum. We describe 
the structure of solutions for this integer optimization problem and pro¬ 
pose an algorithm with complexity 0{N log N) for solving it. In contrast 
to fractional rounding and randomized rounding, which yield biased esti¬ 
mators of the solution when applied to this problem, our method yields 
an exact solution, which minimizes the relative rounding error across the 
set of all solutions for any value of p > 1, while avoiding the complexity 
of exhaustive search. The proposed algorithm also solves a class of inte¬ 
ger optimization problems with integer constraints and may be used as 
the rounding step of relaxed integer programming problems, for rounding 
real-valued solutions. 

Keywords: integer optimization, optimal rounding, randomized rounding, round¬ 
ing heuristic. Apportionment problem, quota methods. 
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Introduction 


The rounding, or integer approximation, of real numbers is a key step in many 
algorithms used in integer optimization 0111120], whereby 

(i) an optimization problem over integers is replaced by a corresponding prob¬ 
lem over real numbers (’relaxation’ step); 

(ii) the real solution obtained in (i) is ’rounded’ to obtain an integer solution 
satisfying the constraints of the original problem (rounding step). 

If the objective function of the relaxed problem is linear, convex or has some 
other special property, step (i) may be solved using efficient numerical methods 
with polynomial complexity in the dimension N of the problem. The rounding 
step, on the other hand, may be described as a constrained integer optimization 
problem over {0,1}'^ for which no generic polynomial algorithm is known. 

Given the large dimensionality of integer programming problems arising in 
many applications, exhaustive search on {0,1}^ is certainly not an option. 
Randomized rounding has been extensively used and analyzed as an alternative 
|16j . Yet in many instances randomized rounding may result in a substantial 
loss in accuracy [20]. Thus, in practice, the final rounding step sets a lower 
bound on the overall accuracy of many integer optimization algorithms, which 
illustrates the importance of good rounding algorithms. 

Many integer optimization problems, such as scheduling of tasks on parallel 
machines [HllllII], or the proportional allocation of seats to political parties in 
elections with party list voting systems mm. are naturally subject to integer 
constraints. The latter problem, known as the apportionment problem, has a 
long history in mathematics, dating back to Polya [HdS], and continues to gen¬ 
erate a lot of interest 017]. Relaxation to real variables followed by rounding 
each component to the nearest integer may typically fail to satisfy such con¬ 
straints and many different -and non-equivalent- methods exist for obtaining 
approximate or exact solutions satisfying the integer constraints pindiiiin]- 
Most of these methods are based on heuristics which provide approximate so¬ 
lutions. Some algorithms, based on randomized rounding may yield a bias in 
finite samples, which may or may not vanish asymptotically 00 . Even in 
the case where they yield exact solutions, the mathematical properties of such 
algorithms have not been systematically analyzed until recently m- 

The present work is an attempt to complement this picture by demonstrating 
the link between various families of such optimal rounding problems, proposing 
a polynomial algorithm for solving them and giving a systematic analysis of the 
optimality and convergence properties of this algorithm and comparing it to 
some popular methods. 

Outline In this paper we formulate and study the problem of optimal rounding 
of a set of real numbers under integer constraints. The formulation of the 
problem is given in Section[TJ In Section0we study the structure of the problem 
and show how it can be reduced it to a sequence of unconstrained rounding 
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problems. Based on this insight, in Section [3] we propose an algorithm with 
polynomial complexity for solving this problem and analyze its convergence 
properties and computational complexity. Finally, in Section 31 we discuss how 
commonly used rounding methods perform when applied to our problem setting: 
in particular, we show that randomized rounding yields a systematically biased 
solution when applied to the problem at hand. 

1 Optimal rounding under integer constraints 

1.1 Problem set-up 

Denote by Z the set of integers, N the set of non-negative integers and R the 
set of real numbers. For a vector x = [xi, ...,xn) S and g > 1, denote 

/ N \ i/"? 

For any real number y S M, we denote 

floor(y) = supjm S Z, m < y} cei(y) = infjm S Z, m > y} 

The problem of optimal rounding under integer constraints can be formu¬ 
lated in the following way: 

Problem 1 (Optimal rounding under integer constraints) Let q > 1. 

Given positive real numbers x = (xi, ...,xjv) S with 

N 

'^x, = MgN ( 1 ) 

find a set of integers m = (toi, ..., ttiat) £ which minimizes 

( N \ N 

\xi - I under '^mi = M. (2) 

i^l / i^l 

We denote the corresponding (L'^) rounding error 

N 

= inf{||x — m||g, m € ,'^mi = M}. (3) 

i=l 

The non-trivial feature of the problem is the presence of the integer constraint. 
As the example x = (2.25,3.4,4.35) shows, componentwise rounding to the 
nearest integer may fail to satisfy such a constraint. 

Problem [T] is a special case of the following integer programming problem. 
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Problem 2 Given a continuous function / : ^ K. find a set of integers 

m = (mi, ...,mjv) G which minimizes 


N 


inf fim) under > mi = M G N. 

mGNW ^ ^ 


(4) 


This is an optimization problem over the finite set 


N 


{m G ^ mi = M} 


so the infimum is always attained. We denote by 


N 


P(/) = min{/(m), m G mj = M} 


(5) 


the value of this minimum. However, the size of this set increases exponentially 
with N, so at first sight, Problems [T] and [5] appear to be integer optimization 
problems with exponential complexity. 

Our contribution is to study the structure of these problems and show that 
they can be solved using an algorithm with polynomial complexity in N. We first 
show in Section!^ that, notwithstanding the constraint, the solution necessarily 
consists in rounding each component either up or down (Proposition [T|). We 
can thus reformulate the problem as an optimization problem on {0,1}'^. Next, 
we propose in Section [3] an algorithm which solves the problem with complexity 
iVlogiV. 

1.2 Related problems and ramifications 

Problem [1] is a ’pure integer programming’ problem in the sense that the re¬ 
laxation to the case where m G is trivial. As such, it enters as a building 
block in many integer and mixed-integer programming problems in which one 
first solves a relaxation of the problem to real variables then projects back the 
solution of the relaxed problem onto Z^. 

The following problem arises e.g. in rounding problems encountered in ac¬ 
counting, where one rounds N entries while leaving the total unchanged up to 
the nearest dollar: 

Problem 3 (Decimal approximation with a given precision on the sum) 

Given positive real numbers x = {xi, ...,xn) G find decimal approximations 
with k decimal digits y = {yi, ...,y]sf) G 10“^N^ which minimize 


N 


N 


N 



under 



( 6 ) 
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It is clear that Problem [T] may have multiple solutions in the case where at 
least two components i,j have equal fractional components. In this case one 
might consider minimizing the relative rounding error among all solutions of 
Problem [TJ 

Problem 4 (Optimal rounding with smallest relative error) Given pos¬ 
itive real numbers x = {xi, ...,xn) G R+j find m* — (m*,m^) S such 
that 


E 




N 

= min{ 

2=1 



Vq{m) = 


min 


V,{z) 


}• (7) 


Another problem which is equivalent to Problem [T] is that of rounding of a 
vector of decimal numbers under the constraint that their sum is conserved to 
within a given precision, often expressed in terms of number of significant digits 
after the decimal. This problem arises, for example, in accounting, where each 
figure contributing to a total is rounded, say, to the nearest cent. Financial 
statements of many companies routinely carry the warning that ’’numbers may 
not add up due to rounding.” This problem may be formulated as follows: 

Problem 5 (Decimal approximation with a given precision on the sum) 

Given positive real numbers x = (xi, ...,X]\f) £ find a decimal number with 
k decimal digits y = (j/i,..., yv) £ 10“*N^ which minimizes 

N N N 

'^\xi-mi\‘^ under | ^ ^ yi| < 10“'". (8) 

i—1 2 = 1 2=1 


Although the precision constraint is an inequality, it is readily observed that 
this problem is in fact equivalent to Problem [T] applied to IQ^x. 

Finally, let us mention a formulation of the optimal rounding problem based 
on relative errors, in which the sum of the absolute rounding errors is replaced 
by a product of relative rounding errors: 

Problem 6 Given positive real numbers x = (a;i, ...,Xn) £ R+, find 
(toi, ..., mjv) £ which minimizes 


N 


n 


\xi - mi\'^ 


under 


N 

rui = M. 

2=1 


(9) 


1.3 Applications 

Problem [1] arises in many applications involving allocation of indivisible re¬ 
sources. Many of these applications involve solving an integer optimization 
problem, which is generally done by first relaxing it to a continuous optimiza¬ 
tion problem, then rounding the solution to find an approximate integer solution 
which needs to conserve the sum. Here, we point out a few applications which 
appear prominently in various fields. 
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Example 1 (Apportionment problem) A first example is the apportion¬ 
ment problem which arises in proportional election systems, for allocating a 
total of M seats to N political parties such that each party gets a number of 
seats that is proportional to the number of votes received. Given that seats are 
indivisible, this is a rounding problem and the optimality criterion in [I] reflects 
the fact that one tries, in the seat allocation, to stay as close as possible to 
the true proportions observed in the votes. The constraint on the sum arises 
through the fixed number of seats to be allocated. 

The same mathematical problem arises if seats are to be apportioned before 
the election between constituencies according to their populations. See Balinski 
and Young [T] for a detailed exposition and Grimmett [1] for a discussion in 
the context of the European Parliament. Here N is typically small while M 
may be very large, which means that the rounding step affects the allocation 
significantly. 

This problem has a long history in mathematics, dating back to Polya [H 
[S], and continues to generate a lot of interest [nmn]. 

Another example is the asset allocation problem: the problem of determining 
the optimal mix of N assets in a portfolio. This problem is classically treated as a 
continuous optimization problem, but in fact assets are purchased in indivisible 
shares; thus, the implementation of such allocations involves a rounding step 
which is usually ignored in the theoretical analysis: 

Example 2 (Asset allocation problem) Given N investment opportunities 
available in indivisible units (shares), the asset allocation problem is to find allo¬ 
cation to each investment to optimize a (convex) risk-return tradeoff. Whether 
this is done through a simple mean-variance criterion [10) . more complex vari¬ 
ants involving transaction costs [12) . or expected utility maximization [18) . it 
leads to a problem of the form [2] in which the dimension N may range from 
hundreds to thousands. While classical treatment of this problem [Mill [IB] 
has ignored the rounding error, in pratice this rounding error -and the related 
’integrality gap’- need not be small and may result in a portfolio which lies at 
a finite distance from the efficient frontier, even when N is large. 

Example 3 (Scheduling of unrelated tasks on parallel machines) Another 
instance of rounding problem with integer constraint arises in the problem of 
scheduling M unrelated tasks across N parallel machines, which is itself related 
to the classical ’assignment problem ’ lans]. Each task can be executed by at 
most one machine, at a certain cost. Minimizing the total execution cost leads 
to a Linear Programming (LP) relaxation of the problem, which is followed by 
a rounding operation to obtain the final allocation. Randomized rounding has 
been proposed as a method for this last step m- 

2 Structure of solutions 

We first show that Problem [T] and Problem [2] are indeed equivalent to classical 
’rounding’ problems. 
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Proposition 1 (Restriction to term-by-term rounding) 

Let m* = (to*, G be a solution to Problem[J\ Then 

Vi = l..iV, TO* G {floor(xi),cei(a:i)}. (10) 

Proof: First, note that the feasible set is non-empty and finite, so the infimum 
is attained at some m* € with ^ m* = M. 

If M = ^fioor(a;i) or M = ^cei(a:i) then this means x G and the 
feasible set is reduced to a single element. We exclude this case below and 
assume ^cei(xi) > M > ^fioor(xi). 

Assume to* < fioor(xi) for some i G {1, Then, given that '^rn* = M, 

there exists at j ^ i such that to* > cei(a:j). Then consider y G defined by 

yk=ml for k^{i,j}, yi=m* + l, yj = m* - 1 > i[oor{xj) (11) 

Then we have \^i ~ vA — \^i ~ ''^il “ !> \xj — yj\ < 

\Xj — TO* I SO 

\\x-y\\q <\\x-m*\\g (12) 

which contradicts the definition of to*. 

Proposition 1 shows that Problem 1 can be reduced to a component-by¬ 
component rounding problem, i.e. an optimization problem on {0,1}^. 

We now turn to Problem [5] In addition to continuity, we shall assume the 
following property for /: 

Assumption 1 (Directional convexity) For each i = 1..N, and 

{xi, ..,Xi-i,Xi+i, ...,Xn) G the partial function 

R i-G R 

U -G f{xi,...,Xi-i,U,Xi+i,...,XN) 


is strictly convex. 

For example, if f{x) = 4>i{xi) where ipi : R ^ R is strictly convex then 

/ satisfies the assumption. Note that / need not be strictly convex in a global 
sense. 

Under this assumption, the relaxation to of Problem [51 i.e. 

N 

inf f{y) under } yi = M. 


has a unique solution x* G . 

Proposition 2 Under Assumption[Jl any solution m* = {ml, G to 

Problem verifies 


TO* G {fioor(a;*),cei(a;*)} 


(13) 
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where x* e is the unique solution of the constrained optimization problem 

N 

inf /(y) under '^yi = M. (14) 

Proof: Let x* € be the unique solution to the constrained optimization 
problem (IT4l) . Without loss of generality we may assume that f{x*) = 0 by 
substracting f{x*) from / and consider the non-trivial case ^cei(a;i) > M > 
J2^00l{Xi). 

Assume m* < floor(a;i) for some i G {1, Then, given that = M, 

there exists a,t j ^ i such that m* > cei(a:j). Let z G be given by 

Zk = rrik for k ^ i, Zi = m* + 1 (15) 

Since m* < Zi < x*, we can write Zi = {1 — a)m* + ax* with 0 < a < 1. Noting 
that z is obtaining by modifying a single component of to*, the directional 
convexity property of / implies that 

f{z) < (1 - a)f{m*) + af{x*) = (1 - a)f{m*) < /(to*) 

Now define 

yk=m*k for A: ^ {//}, = to* + 1, j/j = to* - 1 > cei(a;*) > a;* (16) 

Again, noting that y is obtaining by modifying a single component of z and 
writing yj = (1 — (3)zj + fix* with 0 < /3 < 1 we can use the directional 
convexity property of / to obtain 

f{y) < (1 - fi)f{z) + Pfix*) = (1 - P)f{z) < (1 - /3)/(to*) < /(to*) 

Since yi = a;* — 1 + 1 = M, j/G is thus a solution to Problem [5] and 

f{y) < /(ur*) which contradicts the definition of to*. QED. 

3 A polynomial algorithm for optimal rounding 
under integer constraints 

Proposition [1] reduces the complexity of Problem [T] by confining the search to 
to the finite set 

N 

J|{floor(a; i),cei(xi)} 

which can be reparameterized as {0,1}^ i.e. a componentwise rounding prob¬ 
lem. But the size of this set grows exponentially with N^ so optimization through 
exhaustive search is not a feasible, even if N is only moderately large. We now 
exhibit an algorithm which exploits the structure of the problem, in particular 
the constraint, to compute a solution with a polynomial number of operations. 
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Given the structure of the objective function in Problem [1] the idea is to opti¬ 
mize term by term, controling for the constraint at each step. 

We start by rounding all components downwards and compute the constraint 
shortfall I = ^ ^■ If d = 0 this means x is already integer valued 

so one does not need to proceed further. If / > 1 we need to round upwards 
exactly I components to meet the constraint. To choose these components 
optimally, we 

1. sort the indices according to decreasing values of fractional part Xi — 
floor(a;i) = Xi — rrii. 

2. sort indices with equal fractional part in decreasing order of their integer 
part floor(a;i). 

3. In the last step, we proceed to round upwards the first I components 
sorted in this order. 

Steps I) and 2) may be done using a Quicksort algorithm [5]. 

This yields a polynomial algorithm for solving the optimal rounding problem: 


Optimal rounding under integer constraints (ORIC): 

1: Set Vi = l..N,mi = floor(a:i). 

2 : Compute constraint shortfall l{x) = — 0- 

3: If / = 0 then end. 

4 : Sort indices in decreasing order of fractional part {xi — rrii): 

{xi — mi) > ... > (xn — TOiv) > 0. 

5: Sort each subsequence with equal fractional parts {xk — mk) = ■■■ = (xk+j — 
mk+j) in decreasing order of integer parts: > mk+i > > "mk+j- 

6: for k = 1,..., I do 

7 : mk=cei{xk)- 

8: end for 

9: end 

There exists a symmetric version of the algorithm where one initializes with 
mi = cei(a:i) and then needs to round downwards M — I oi the components. It 
is readily verified that the two methods yield the same solutions. 

A similar algorithm, based on the sorting of fractional components, but 
without the sorting step (5), has been used for a long time in the context of 
proportional seat allocation for representative assemblies with party list vot¬ 
ing systems [I], where it is known as the Hare-Niemeyer or ’largest remainder 
method’. The focus of the Hare-Niemeyer and related methods is to achieve 
a ’fair’ allocation rather than to minimize a given objective function, so the 
notion of optimality considered here may or may not be relevant for such appli¬ 
cations and more complex considerations apply; we refer to Balinski & Young [T] 
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for a detailed discussion of seat allocation methods in elections. Nevertheless, 
the largest remainder method is a special case of the method considered here, 
when all fractional parts are distinct and the analysis of optimality bears many 
similarities m- 

To quantify the complexity of the algorithm, we first note that 

N 

I = '^{Xi - mj) < TV, 

i=l 

thus the sorting steps (Steps 4-5) may be achieved through a sorting algorithm 
such as Quicksort [B] with complexity ^ TV log TV Hi- Once the sorting has 
been done, the rounding of the sorted sequence (Steps 6-8) requires / < TV — 1 
operations. So, overall, the complexity is dominated by the sorting step: 

Proposition 3 The ORIC algorithm solves Problem [J\ for all q > 1, with a 
computational complexity of N log N for typical input vectors. It converges to a 
vector m* G satisfying ixii = M which is a solution to Problem^ and 

Problem\^for all values of q > 1. 

Proof Due to the ordering of the indices in the sorting step 4 algorithm yields 
a vector {xi — rn*,i = \..N) which is componentwise smaller than {xi — mi,i = 
1..N) for any other element of the feasible set. So for any compnentwise in¬ 
creasing function, in particular Vq, it yields the minimum. The ordering of 
indices in Step 5 guarantees that when fractional parts are equal, the algorithm 
picks the solution whose componentwise relative error is the smallest, hence the 
characterization above. 

To quantify the complexity, denote by p the number of subsequences with 
lengths Ml,..., Mp inside which the fractional parts are equal. This implies that, 
in addition to the sorting of Step 4, we need to do sort these p subsequences 
according to integer parts. We sort each of these batches using a Quicksort 
algorithm with complexity Mk logM^, leading to an overall complexity of 

p 

NlogN -\-^Mk log Mk (17) 

k^l 

where the second term corresponds to the sorting of the p batches. Let ,5 < 1 
define the order or magnitude of the longest subsequence: inax{Mk, k = l..p) 
and TV“ , a < 1 denote the number of subsequences with length ^ . Then 

a P < \ and the order of magnitude of the complexity of the second term in 
CZl) is given by 


\og{N^) = /3N“+'^ log N <pN log N. 

Thus, aside from a prefactor, the sorting of subsequences according to integer 
parts (Step 5) does not increase the order of the complexity, which is determined 
by the global sorting (Step 4). 
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Remark 1 The ORIC algorithm also provides a solution to Problem\^for all 
q>l. 


4 Comparison with other rounding methods 

The computational complexity of the ORIC algorithm is dominated by the sort¬ 
ing step, whose complexity for a typical vector x S is 0{N log N) [^. How¬ 
ever, this step is essential and any attempt to bypass it with simpler rounding 
methods, whether deterministic [20] or randomized m, may fail to yield the 
optimal solution. The asymptotic bias of rounding methods has been studied 
by Diaconis & Freedman [5] and more recently by Janson [7]. The argument 
of vanishing asymptotic bias is often used to argue that these methods yield 
’unbiased’ solutions. We will argue here that, unlike what is suggested by the 
asymptotic properties, the finite sample solution is in fact systematically bi¬ 
ased, in a way that has significant implications for the applications considered 
in Section o 

4.1 Fractional rounding 

A rounding algorithm, often used by default, is fractional rounding, which 
rounds to floor(a;) (resp. cei(a:)) if Xi — floor(a;i) < q (resp. Xi — floor(a;i) > q) 
where 0 < q < 1. q = 1I2 corresponds to mid-point rounding. Denote by 

N{q, x) = {i = 1..N, Xi — floor(a:i) < q}. 

Fractional rounding with parameter q yields the optimal solution only if the 
distance to the constraint shortfall I{x) = '^^^i{xi — mi) verifies 

I{x) = N{q,x). 

Obviously this condition depends on x £ and it is easily observed that there 
cannot exist any 0 < g < 1 which verifies I{x) = N{q, x) for all x £ 

For a given x, there is always a 0 < q{x) < 1 which verifies I (x) = N{q(x), x), 
but the value of q{x) depends on x and a fractional rounding algorithm with a 
fixed q (such as mid-point rounding) will yield the optimal solution to Problem 
[T]only for x satisfying I{x) = N{q,x) and not otherwise. 

So, a fractional rounding rule fails to yield the optimal solution to Problem 
[T]for all X £ 

4.2 Randomized rounding 

We now compare the algorithm described above with randomized rounding m, 
in which each Xi is rounded up with probability pi = Xi — floor(xi)■ Randomized 
rounding thus yields a solution given by 

R = U + floor(x) (18) 
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where t/ is a random variable with values in {0,1}'^ and 

N 

i=l 

Assume, without loss of generality, that 1 > pi > ... > Pn > 0. Let I = 
— floor(a::i)) and r = J2f=i+i{xi — floor(a:i)). Then the optimal solution 
of Problem [1] corresponds to 

m* = (1,1,..., 1, 0, ...0) + floor(x) (19) 

I 

The probability that randomized rounding gives an incorrect solution is r/I. 
This probability can be higher than 50%, as the following example shows. 

Example 4 Let N = 3 and x — m = (0.4,0.35,0.25). The optimal solution 
is to round up 0.4 and round down the other components to zero. However, 
in randomized rounding there is a 60% probability that one of the other 2 get 
rounded up i.e. a 60% probability of a non-optimal solution. 

Since when N is large the proportion of components rounded up is 

asymptotically equal to the optimal one, i.e. / /N and, by the strong law of large 
numbers, the constraint is satisfied with probability 1 for N oo. However, the 
randomized estimator m is biased and this bias remains systematic, even for 
N large. In fact, in the case where none of the components are integers Xi ^ Z, 
randomized rounding yields a systematic bias, whose sign is determined by the 
rank of Xi —floor(a;i) in the ordering xi —floor(a;i) > ... > p^ = xn — floor(a;Ar): 


Proposition 4 Randomized rounding applied to Problem]^ yields a biased so¬ 
lution: if 1 > Pi = xi — floor(a;i) > ... > pn = xn — floor(xAr) > 0 then 

E[R\<m* for i = l..I, and E[F{\>m* for i = I-\-l...,N. 


This follows from the form cm of the optimal solution and the fact that 0 < 
Pi < \. Though the main justification often advanced for randomized rounding 
is that ’it yields an unbiased estimator of the solution’, as Proposition|4] shows, 
randomized rounding leads to a systematic upward bias in components whose 
fractional part is small. 

This leads to a solution that is non-optimal in ways that are not intended. 
For instance, in the asset allocation problem (Example [5|) , the resulting bias 
depends not on the allocation to each aseet but only on the fractional part of 
this allocation. The result is a portfolio which lies at a random distance from the 
efficient frontier. By contrast, the solution obtained using the ORIC algorithm 
is guaranteed to minimize the distance to the efficient frontier: this distance is 
explicitly given by the value of the optimum in ([5]) . 
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